Federated learning on non-IID data: A survey
نویسندگان
چکیده
Federated learning is an emerging distributed machine framework for privacy preservation. However, models trained in federated usually have worse performance than those the standard centralized mode, especially when training data are not independent and identically (Non-IID) on local devices. In this survey, we provide a detailed analysis of influence Non-IID both parametric non-parametric horizontal vertical learning. addition, current research work handling challenges reviewed, advantages disadvantages these approaches discussed. Finally, suggest several future directions before concluding paper.
منابع مشابه
a head parameter survey on mazandarani dialect and its effect(s) on learning english from ca perspective (on the basis of x-bar syntax)1
there has been a gradual shift of focus from the study of rule systems, which have increasingly been regarded as impoverished, … to the study of systems of principles, which appear to occupy a much more central position in determining the character and variety of possible human languages. there is a set of absolute universals, notions and principles existing in ug which do not vary from one ...
15 صفحه اولLearning Homophily Couplings from Non-IID Data for Joint Feature Selection and Noise-Resilient Outlier Detection
This paper introduces a novel wrapper-based outlier detection framework (WrapperOD) and its instance (HOUR) for identifying outliers in noisy data (i.e., data with noisy features) with strong couplings between outlying behaviors. Existing subspace or feature selection-based methods are significantly challenged by such data, as their search of feature subset(s) is independent of outlier scoring ...
متن کاملPractical Secure Aggregation for Federated Learning on User-Held Data
Secure Aggregation protocols allow a collection of mutually distrust parties, each holding a private value, to collaboratively compute the sum of those values without revealing the values themselves. We consider training a deep neural network in the Federated Learning model, using distributed stochastic gradient descent across user-held training data on mobile devices, wherein Secure Aggregatio...
متن کاملLearning Classifiers When the Training Data Is Not IID
Most methods for classifier design assume that the training samples are drawn independently and identically from an unknown data generating distribution, although this assumption is violated in several real life problems. Relaxing this i.i.d. assumption, we consider algorithms from the statistics literature for the more realistic situation where batches or sub-groups of training samples may hav...
متن کاملChromatic PAC-Bayes Bounds for Non-IID Data
PAC-Bayes bounds are among the most accurate generalization bounds for classifiers learned with IID data, and it is particularly so for margin classifiers. However, there are many practical cases where the training data show some dependencies and where the traditional IID assumption does not apply. Stating generalization bounds for such frameworks is therefore of the utmost interest, both from ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Neurocomputing
سال: 2021
ISSN: ['0925-2312', '1872-8286']
DOI: https://doi.org/10.1016/j.neucom.2021.07.098